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^ Introduction 

•s 

Irreducible representations are the building blocks of general, semisimple Ga- 
lois representations p, and cuspidal representations are the building blocks of 
. automorphic forms 7r of the general linear group. It is expected that when 

an object of the former type is associated to one of the latter type, usually 
in terms of an identity of L-functions, the irreducibility of the former should 
imply the cuspidality of the latter, and vice-versa. It is not a simple matter - 
at all - to prove this expectation, and nothing much is known in dimensions 
\Q ■ > 2. We will start from the beginning and explain the problem below, and 

indicate a result (in one direction) at the end of the Introduction, which sum- 
marizes what one can do at this point. The remainder of the paper will be 
devoted to showing how to deduce this result by a synthesis of known theo- 
rems and some new ideas. We will be concerned here only with the so called 
easier direction of showing the cuspidality of it given the irreducibility of p, 
and refer to [Ra5] for a more difficult result going the other way, which uses 
crystalline representations as well as a refinement of certain deep modularity 
results of Taylor, Skinner- Wiles, et al. Needless to say, easier does not mean 
easy, and the significance of the problem stems from the fact that it does 
arise (in this direction) naturally. For example, 7r could be a functorial, auto- 
morphic image r(rj), for r\ a cuspidal automorphic representation of a product 
of smaller general linear groups: H(A) = TJ . GL(rrij,A), with an associated 
Galois representation o such that p = r(er) is irreducible. If the automorphy 
of 7r has been established by using a flexible converse theorem ([CoPSl]), 
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then the cuspidality of it is not automatic. In [RaS], we had to deal with 
this question for cohomological forms 7r on GL(6), with H = GL(2) x GL(3) 
and r the Kronecker product, where n ia automorphic by [KShl]. Besides, 
the main result (Theorem A below) of this paper implies, as a consequence, 
the cuspidality of n = sym 4 (?]) for i] defined by any non-CM holomorphic 
newform ip of weight > 2 relative to T (N) C SL(2, Z), without appealing to 
the criterion of [KSh2]; here the automorphy of tt is known by [K] and the 
irreducibility of p by [Ri]. 

Write Q for the field of all algebraic numbers in C, which is an infinite, 
mysterious Galois extension of Q. One could say that the central problem in 
algebraic Number theory is to understand this extension. Class field theory, 
one of the towering achievements of the twentieth century, helps us under- 
stand the abelian part of this extension, though there are still some delicate, 
open problems even in that well traversed situation. 

Let Qq denote the absolute Galois group of Q, meaning Gal(Q/Q). It is 
a profinite group, being the projective limit of finite groups Gal(K/Q), as K 
runs over number fields which are normal over Q. For fixed K, the Tcheb- 
otarev density theorem asserts that every conjugacy class C in Gal(if/Q) is 
the Frobenius class for an infinite number of primes p which are unramified 
in K. This shows the importance of studying the representations of Galois 
groups, which are intimately tied up with conjugacy classes. Clearly, every C- 
representation, i.e., a homomorphism into GL(n, C) for some n, of Gal(K/Q) 
pulls back, via the canonical surjection Qq — > Gal(fT/Q), to a representation 
of Qq, which is continuous for the profinite topology. Conversely, one can 
show that every continuous C-representation p of Qq is such a pull-back, for 
a suitable finite Galois extension K/Q. E. Artin associated an L-function, 
denoted L(s,p), to any such p, such that the arrow p — > L(s,p) is additive 
and inductive. He conjectured that for any non-trivial, irreducible, continu- 
ous C-representation p of Qq, L(s,p), is entire, and this conjecture is open 
in general. Again, one understands well the abelian situation, i.e., when p 
is a 1-dimensional representation; the kernel for such a p defines an abelian 
extension of Q. By class field theory, such a p is associated to a character £ of 
finite order of the idele class group A*/Q*; here, being associated means they 
have the same L-function, with L(s,£) being the one introduced by Hecke, 
albeit in a different language. As usual, we are denoting by A = E x Aj 
the topological ring of adeles, with Af — Z <g) Q, and by A* its multiplicative 
group of ideles, which can be given the structure of a locally compact abelian 
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topological group with discrete subgroup Q*. 

Now fix a prime number t, and an algebraic closure Q e of the field of 
£-adic numbers Q^, equipped with an embedding Q <^-> Q e . Consider the set 
TZe(n, Q) of continuous, semisimple representations 

pe ■ Gq -> GL(n,Q £ ), 

up to equivalence. The image of Gq in such a representation is usually not 
finite, and the simplest example of that is given by the £-adic cyclotomic 
character xe given by the action of Gq on all the £-power roots of unity in 
Q. Another example is given by the 2-dimensional £-adic representation on 
all the £-power division points of an elliptic curve E over Q. 

The correct extension to the non-abelian case of the idele class character, 
which appears in class field theory, is the notion of an irreducible automorphic 
representation n of GL(n). Such a n is in particular a representation of the 
locally compact group GL(n, A F ), which is a restricted direct product of the 
local groups GL(n, Q v ), where v runs over all the primes p and oo (with Qoo = 
R). There is a corresponding factorization of 7r as a tensor product <S> v tt v , with 
all but a finite number of n p being unramified, i.e., admitting a vector fixed 
by the maximal compact subgroup K v . At the archimedean place oo, tYoo 
corresponds to an n-dimensional, semisimple representation cr^oc) of the real 
Weil group Wr, which is a non-trivial extension of Gal(C/R) by C*. Globally, 
by Schur's lemma, the center Z(A) ~ A* acts by a quasi-character u, which 
must be trivial on Q* by the automorphy of ir, and so defines an idele class 
character. Let us restrict to the central case when n is essentially unitary. 
Then there is a (unique) real number t such that the twisted representation 
tt u := ir(t) — 7r <g) | • |* is unitary (with unitary central character u u ). We are, 
by abuse of notation, writing | • |* to denote the quasi-character | • |* o det of 
GL(n, A), where |-| signifies the adelic absolute value, which is trivial on Q* by 
the Artin product formula. Roughly speaking, to say that rr is automorphic 
means n u appears (in a weak sense) in L 2 (Z(A)GL(n, Q)\GL(n, A), uj u ), on 
which GL(n, A^) acts by right translations. A function ip in this L 2 -space 
whose averages over all the horocycles are zero is called a cusp form, and 
7r is called cuspidal if n u is generated by the right GL(n, A j p)-translates of 
such a <f. Among the automorphic representations of GL(n, A) are certain 
distinguished ones called isobaric automorphic representations. Any isobaric 
7r is of the form 7Ti EH 7r 2 EB ■ • • EH n r , where each ttj is a cuspidal representation 
of GL(rij, A), such that (ni,n 2 , ■ ■ ■ ,n r ) is a partition of n, where EH denotes 
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the Langlands sum (coming from his theory of Eisenstein series) ; moreover, 
every constituent iTj is unique up to isomorphism. Let A(n, Q) denote the 
set of isobaric automorphic representations of GL(n, A) up to equivalence. 
Every isobaric n has an associated L-function L(s,n) = Y[ v L(s, ir v ), which 
admits a meromorphic continuation and a functional equation. Concretely, 
one associates at every prime p where n is unramified, a conjugacy class 
A(ti) in GL(n, C), or equivalently, an unordered n-tuple (ai tP , a 2tP , ■ ■ ■ , ot n ,p) 
of complex numbers so that 

n 

L(s,tt p ) = Y[(l - a jiP p- s )-\ 

If 7r is cuspidal and non-trivial, L(s, n) is entire; so is the incomplete one 
L s (s, 7r) for any finite set S of places of Q. 

Now suppose pi is an n-dimensional, semisimple £-adic representation of 
Qq = Gal(Q/Q) corresponds to an automorphic representation ix of GL(n, A). 
We will take this to mean that there is a finite set S of places including £, oo 
and all the primes where pe or tt is ramified, such that we have, 

(0.1) L(s,n p ) = L p (s,p e ), \fpi S, 

where the Galois Euler factor on the right is given by the characteristic 
polynomial of Fr p , the Frobenius at p, acting on p£. When (0.1) holds (for a 
suitable S), we will write 

Pe <-> tt. 

A natural question in such a situation is to ask if it is cuspidal when pi 
is irreducible, and vice-versa. It is certainly what is predicted by the general 
philosophy. However, proving it is another matter altogether, and positive 
evidence is scarce beyond n — 2. 

One can answer this question in the affirmative, for any n, if one restricts 
to those pi which have finite image. In this case, it also defines a continuous, 
C-representation p, the kind studied by E. Artin ([A]). Indeed, the hypothesis 
implies the identity of L-functions 

(0.2) L s (s, p®p w ) = L s (s, 7T X tt v ), 

where the superscript S signifies the removal of the Euler factors at places 
in S, and p v (resp. 7r v ) denotes the contragredient of p (resp. it). The L- 
function on the right is the Rankin- Selberg L-function, whose mirific prop- 
erties have been established in the independent and complementary works of 
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Jacquet, Piatetski-Shapiro and Shalika ([JPSS], and of Shahidi ([Shi, 2]); see 
also [MW]. A theorem of Jacquet and Shalika ([JS1]) asserts that the order 
of pole at s = 1 of L (s, n x 7r v ) is 1 iff n is cuspidal. On the other hand, for 
any finite-dimensional C-representation r of Qq, one has 

(0.3) -ord s=1 L s (s,r) = dim c Hom eQ (l, r), 

where 1 denotes the trivial representation of Qq. Applying this with r = 
p £g> p v ~ End(p), we see that the order of pole of L s (s,p <g> p v ) at s = 1 
is 1 iff the only operators in End(p) which commute with the (^-action are 
scalars, which means by Schur that p is irreducible. Thus, in the Artin case, 
7r is cuspidal iff pe is irreducible. 

For general £-adic representations pe of Qq, the order of pole at the right 
edge is not well understood. When pp comes from arithmetic geometry, i.e., 
when it is a Tate twist of a piece of the cohomology of a smooth projective 
variety over Q which is cut out by algebraic projectors, an important conjec- 
ture of Tate asserts an analogue of (0.3) for t — pi® pi, but this is unknown 
except in a few families of examples, such as those coming from the theory 
of modular curves, Hilbert modular surfaces and Picard modular surfaces. So 
one has to find a different way to approach the problem, which works at least 
in low dimensions. 

The main result of this paper is the following: 

Theorem A Let n < 5 and let t be a prime. Suppose pe <-> n, for an iso- 
baric, algebraic automorphic representation n of GL{n, A) , and a continuous, 
t-adic representation pi of Qq. Assume 

(i) pa is irreducible 

(ii) Ti is odd if n > 3 

(Hi) ii is semi-regular ifn — A, and regular if n = 5 

Then it is cuspidal. 

Some words of explanation are called for at this point. An isobaric au- 
tomorphic representation n is said to be algebraic ([C£l]) if the restriction 
of o^TToo) to C* is of the form ©" =1 Xj, with each Xj algebraic, i.e., of the 
form z — + z p 3~z q j with Pj,qj G Z. (We do not assume that our automorphic 
representations are unitary, and the arrow — > a(7r 00 ) will be normalized 
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arithmetically.) For n — 1, an algebraic it is an idele class character of type 
A in the sense of Weil. One says that 7r is regular iff er^oo) |c* is a direct sum 
of characters Xji each occurring with multiplicity one. And ir is semi-regular 
([BHR]) if each Xj occurs with multiplicity at most two. Suppose £ is a 1- 
dimensional representation of Wr. Then, since ~ R*, £ is defined by a 
character of R* of the form x — > |:r| w • sgn(x) a ^\ with a(£) G {0, 1}; here sgn 
denotes the sign character of IR*. For every iu, let <7<x>[£] := c^ooC^y^))^] 
denote the isotypic component of £, which has dimension at most 2 (resp. 1) 
if 7r is semi- regular (resp. regular), and is acted on by R*/R+ ~ {±1}- We 
will call a semi-regular tt odd if for every character £ of Wr, the eigenvalues 
of R*/R+ on the ^-isotypic component are distinct. Clearly, any regular n is 
odd under this definition. See section 1 for a definition of this concept for 
any algebraic ir, not necessarily semi-regular. 

I want to thank the organizers, Jae-Hyun-Yang in particular, and the 
staff, of the International Symposium on Representation Theory and Auto- 
morphic Forms in Seoul, Korea, first for inviting me to speak there (during 
February 14 — 17, 2005), and then for their hospitality while I was there. The 
talk I gave at the conference was on a different topic, however, and dealt 
with my ongoing work with Dipendra Prasad on selfdual representations. I 
would also like to thank F. Shahidi for helpful conversations and the referee 
for his comments on an earlier version, which led to an improvement of the 
presentation. It is perhaps apt to end this introduction at this point by 
acknowledging support from the National Science Foundation via the grant 
DMS - 0402044. 



1 Preliminaries 

1.1 Galois Representations 

For any field k with algebraic closure, denote by Gk the absolute Galois group 
of k over k. It is a projective limit of the automorphism groups of finite Galois 
extensions E/k. We furnish Qt as usual with the profinite topology, which 
makes it a compact, totally disconnected topological group. When k = ¥ p , 
there is for every n a unique extension of degree n, which is Galois, and 
(?f p is isomorphic to Z ~ lim n Z/n, topologically generated by the Frobenius 
automorphism x — > x p . 
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At each prime p, let G P denote the local Galois group Gal(Q p /Q p ) with 
inertia subgroup I p , which fits into the following exact sequence: 

(1.1.1) 1 - I P - G P - G ¥p - 1. 

The fixed field of Q p under I p is the maximal unramified extension Q p Y of Q p , 
which is generated by all the roots of unity of order prime to p. One gets a 
natural isomorphism of Gal(Qp r /Q p ) with Gw p - If K/Q is unramified at p, 
then one can lift the Frobenius element to a conjugacy class y? p in Gal(fT/Q). 

All the Galois representations considered here will be continuous and 
finite-dimensional. Typically, we will fix a prime £, and algebraic closure Q e 
of the field of £-adic numbers, and consider a continuous homomorphism 

(1.1.2) p e : Gq -> GL(Vi), 

where is an n-dimensional vector space over Q e . We will be interested 
only in those pe which are unramified only at a finite set S of primes. Then 
pi factors through a representation of the quotient group Gs '■= G(Qs/Q), 
where Qs is the maximal extension of Q which is unramified out side S. One 
has the Frobenius classes (f> p in Gs f° r & U P S, an d this allows one to define 
the L-factors (with s G C) 

(1.1.3) L p (s, Pe ) = det (I - ip p p~ s [Ve)- 1 . 

Clearly, it is the reciprocal of a polynomial in p~ s of degree n, with constant 
term 1, and it depends only on the equivalence class of p£. One sets 

(1.1.4) L s (s,p e ) = l[L p (s,p e ). 

When p£ is the trivial representation, it is unramified everywhere, and L s (s, pi) 
is none other than the Riemann zeta function. To define the bad factors at p 
in S — {£}, one replaces Vi in this definition by the subspace V e p of inertial 
invariants, on which tp p acts. 

We are primarily interested in semisimple representations in this article, 
which are direct sums of simple (or irreducible) representations. Given any 
representation p^ of Gq, there is an associated semisimplification, denoted 
pf, which is a direct sum of the simple Jordan-Holder components of pe. A 
theorem of Tchebotarev asserts the density of the Frobenius classes in the 
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Galois group, and since the local p-factors of L(s,pg) are defined in terms of 
the inverse roots of ip p , one gets the following standard, but useful result. 

Proposition 1.1.5 Let pe,p' e be continuous, n- dimensional I- adic represen- 
tations ofQq. Then 

L s (s,p e )=L s (s,p[) =► p7^pT- 

The Galois representations pe which have finite image are special, and one 
can view them as continuous C-representations p. Artin studied these deeply, 
and showed, using the results of Brauer and Hecke, that the corresponding 
L-functions admit meromorphic continuation and a functional equation of 
the form 

(1.1.6) L*(s,p) = e( S ,p)L*(l- S ,p v ), 

where p v denotes the contragredient representation on the dual vector space, 
where 

(1.1.7) L*(s,p) = L^p^^p), 

with the archimedean factor Loo(s, p) being a suitable product (shifted) gamma 
functions. Moreover, 

(1.1.8) e(s,p) = W(p)N( P y-^, 

which is an entire function of s, with the (non-zero) W(p) being called the 
root number of p. The scalar N(p) is an integer, called the Artin conductor 
of p, and the finite set S which intervenes is the set of primes dividing N(p). 
The functional equation shows that W(p)W(p v ) = 1, and so W(p) = ±1 
when p is selfdual (which means p ~ p v ). Here is a useful fact: 

Proposition 1.1.9 ([T]) Let r be a continuous, finite- dimensional ^.-representation 
°f Gq, unramified outside S. Then we have 

-ord s= iL s (s,r) = Homg Q (l,r). 

Corollary 1.1.10 Let p be a continuous, finite-dimensional C-representation 
of Qq, unramified outside S. Then p is irreducible iff the incomplete L- 
function L s (s, p <8> p v ) has a simple pole at s = 1. 
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Indeed, if we set 



(1.1.11) t : = p® p v ~ End(p), 

then Proposition 1.1.9 says that the order of pole of L(s, p<g>p v ) at s = 1 is the 
multiplicity of the trivial representation in End(p) is 1, i.e., iff the commutant 
Endg Q (p) is one-dimensional (over C), which in turn is equivalent, by Schur's 
lemma, to p being irreducible. Hence the Corollary. 

For general £-adic representations pt, there is no known analogue of 
Proposition 1.1.9, though it is predicted to hold (at the right edge of ab- 
solute convergence) by a conjecture of Tate when pe comes from arithmetic 
geometry (see [Ra4], section 1, for example). Tate's conjecture is only known 
in certain special situations, such as for CM abelian varieties. For the L- 
functions in Tate's set-up, say of motivic weight 2m, one does not even know 
that they make sense at the Tate point s — m + 1, let alone know its order 
of pole there. Things get even harder if p e does not arise from a geometric 
situation. One cannot work in too general a setting, and at a minimum, one 
needs to require pe to have some good properties, such as being unramified 
outside a finite set S of primes. Fontaine and Mazur conjecture ([FoM]) that 
Pe is geometric if it has this property (of being unramified outside a finite S) 
and is in addition potentially semistable. 

1.2 Automorphic Representations 

Let F be a number field with adele ring Ap = x Apj, equipped with the 
adelic absolute value | • | = | • |a- For every algebraic group G over F, let 
G(A F ) = (^(Fqo) x G(A F j) denote the restricted direct product Yl' v G(F v ), 
endowed with the usual locally compact topology. Then G(F) embeds in 
G(A F ) as a disct=rete subgroup, and if Z n denotes the center of GL(n), 
the homogeneous space GL(n, F) Z (Ap)\GL(n, Ap) has finite volume relative 
to the relatively invariant quotient measure induced by a Haar measure on 
GL(n, A F ). An irreducible representation n of GL(n, A^) is admissible if it 
admits a factorization as a restricted tensor product ®' v n V) where each n v 
is admissible and for almost all finite places v, n v is unramified, i.e., has a 
no-zero vector fixed by K v = GL(n,O v ). (Here, as usual, O v denotes the 
ring of integers of the local completion F v of F at v.) 
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Fixing a unitary idele class character uj, which can be viewed as a char- 
acter of Z n (A F ), we may consider the space 

(1.2.1) L 2 (n, uj) := L 2 (GL(n, F)Z(A F )\GL(n, A f ),oj), 

which consists of (classes of) functions on GL(n, A F ) which are left-invariant 
under GL(n, F), transform under Z(A F ) according to uj, and are square- 
integrable modulo GL(n, F)Z(A F ). Clearly, L 2 (n, uj) is a unitary representa- 
tion of GL(n, A F ) under the right translation action on functions. The space 
of cusp forms, denoted L^(n, uj), consists of functions in L 2 (n,uj) which 
satisfy the following for every unipotent radical U of a standard parabolic 
subgroup P = MU : 

(1.2.2) / (p(ux) = 0. 

JU(F)\U(A F ) 

To say that P is a standard parabolic means that it contains the Borel 
subgroup of upper triangular matrices in GL(n). A basic fact asserts that 
Lq(u, uj) is a subspace of the discrete spectrum of L 2 (n,uj). 

By a unitary cuspidal (automorphic) representation n of GL n (A^), we 
will mean an irreducible, unitary representation occurring in Lq(u,uj). We 
will, by abuse of notation, also denote the underlying admissible representa- 
tion by n. (To be precise, the unitary representation is on the Hilbert space 
completion of the admissible space.) Roughly speaking, unitary automorphic 
representations of GL(n, A^) are those which appear weakly in L 2 (n,uj) for 
some uj. We will refrain from recalling the definition precisely, because we will 
work totally with the subclass of isobaric automorphic representations, for 
which one can take Theorem 1.2.10 (of Langlands) below as their definition. 

If 7r is an admissible representation of GL(n, A^), then for any z G C, we 
define the analytic Tate twist of n by z to be 

(1.2.3) tt(z) := 7T ® | • \ z , 

where | • \ z denotes the 1-dimensional representation of GL(n, A^) given by 

g -> \det{g)\ z = e zlo ^ dct(9m . 

Since the adelic absolute value | • | takes det(g) to a positive real number, its 
logarithm is well defined. 
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In general, by a cuspidal automorphic representation, we will mean an 
irreducible admissible representation of GL(n, Ap) for which there exists a 
real number w, which we will call the weight of n such that the Tate twist 

(1.2.4) u u := 7T(>/2) 

is a unitary cuspidal representation. Note that the central character of 7r and 
of its unitary avatar ir u are related as follows: 



'1.2.5) UJ W = UJ-n 



-nw/2 



i 



which is easily checked by looking at the situation at the unramified primes, 
which suffices. 

For any irreducible, automorphic representation n of GL(n, Ap), there 
is an associated L-function L(s,7r) = L(s,7i 00 )L(s,7if), called the standard 
L— function ([J]) of it;. It has an Euler product expansion 



1.2.6) L(s,tt) = l[L(s,n v ), 



convergent in a right-half plane. If v is an archimedean place, then one knows 
(cf. [Lai]) how to associate a semisimple n— dimensional C— representation 
a(7r v ) of the Weil group Wf v , and L(ir v ,s) identifies with L(a v ,s). We will 
normalize this correspondence tt v — > a(ir v ) in such a way that it respects 
algebraicity. Moreover, if v is a finite place where n v is unramified, there is a 
corresponding semisimple conjugacy class A v (ir) (or A(ir v )) in GL(n, C) such 
that 



(1.2.7) L(s,tt v ) = det(l -^(tt)T)- 1 



T= 



We may find a diagonal representative diag(ai 5 „(7r), a n iV (tt)) for A v (ir), 
which is unique up to permutation of the diagonal entries. Let [ai j „(7r), a ni „(7r)] 
denote the unordered n— tuple of complex numbers representing A v (ir). Since 
Wf^ ~ F*, A v (ir) clearly defines an abelian n— dimensional representation 
<t(7t v ) of Wp tV . If 1 denotes the trivial representation of GL(1, Ap), which is 
cuspidal, we have 

L(s,l) = (p(s), 

the Dedekind zeta function of F. (Strictly speaking, we should take L(s, 1^) 
on the left, since the right hand side is missing the archimedean factor, but 
this is not serious.) 
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The fundamental work of Godement and Jacquet, when used in conjunc- 
tion with the Rankin-Selberg theory (see 1.3 below), yields the following: 

Theorem 1.2.8 ([J]) Let n > 1, and n a non-trivial cuspidal automorphic 
representation of GL(n, Ap) . Then L(s, ir) is entire. Moreover, for any finite 
set S of places of F, the incomplete L— function 

L s (s,n) = Y[L(s,n v ) 

is holomorphic and non-zero in !R(s) > w + 1 if n has weight w. Moreover, 
there is a functional equation 

(1.2.9) L(w + 1 - s, tt v ) = e(s, n)L(s, tt) 

with 

e(s,n) = W(7i)Ni w+1 ^ 2 - s . 

Here N n denotes the norm of the conductor Af n of it, and W{n) is the root 
number ofn. 

Of course when w = 0, i.e., when n is unitary, the statement comes to a 
more familiar form. When n — 1, a 7r is simply an idele class character and 
this result is due to Hecke. 

By the theory of Eisenstein series, there is a sum operation EH ([La2], 
[JS1]): 

Theorem 1.2.10 ([JS1]) Given any m— tuple of cuspidal automorphic rep- 
resentations 7Ti,...,7r m of GL(ni, Ap), GL(n m ,Ap) respectively, there ex- 
ists an irreducible, automorphic representation 7Ti EB ... EB n m of GL(n,Ap), 
n = ni + ... + n m , which is unique up to equivalence, such that for any finite 
set S of places, 

m 

(1.2.11) L s (s, EB- ^0 = HL^s,^). 

3=1 

Call such a (Langlands) sum n ~ ES^ =1 7Tj, with each iij cuspidal, an 
isobaric automorphic, or just isobaric (if the context is clear), representation. 
Denote by ram(7r) the finite set of finite places where 7r is ramified, and let 
9T(7r) be its conductor. 
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For every integer n > 1, set: 
(1.2.12) A(n, F) = {n : isobaric representation of GL(n, A^)}/~, 
and 

Ao(n,F) = {n G A{n, F) \ ix cuspidal}. 

Put A(F) = U n >!A(n,F) and A (F) = U n >i^ (^,F). 

Remark 1.2.13. One can also define the analogs of A(n, F) for local 
fields F, where the "cuspidal" subset Ao(n,F) consists of essentially square- 
integrable representations of GL(n, F). See [La3] (or [Ral]) for details. 

Given any polynomial representation 

(1.2.14) r : GL(n,C) -> GL(iV,C), 

one can associate an L-function to the pair (it, r), for any isobaric automor- 
phic representation n of GL(n, A^): 

(1.2.15) L(s,7r;r) = JJ L(s,7r v ;r), 

V 

in such a way that at any finite place v where n is unramified with residue 
field ¥ q , 

(1.2.16) L(s, n v ; r) = det(l - A v (tt; OT)" 1 !^-., 
with 

(1.2.17) A v (n;r) = r{A v {ix)). 

The conjugacy class A v (7r;r) in GL(iV, C) is again represented by an un- 
ordered iV-tuple of complex numbers. 

The Principle of Functoriality predicts the existence of an isobaric 
automorphic representation r{n) of GL(iV, A^) such that 

(1.2.18) L(s,r{n)) = L(s,vr;r) 

A weaker form of the conjecture, which suffices for questions like what we are 
considering, asserts that this identity holds outside a finite set S of places. 

This conjecture is known in the following cases of (n, r): 
(1.2.19) 
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(2,sym 2 ): Gelbart- Jacquet ([GJ]) 

(2,sym 3 ): Kim-Shahidi flKShl]) 

(2,sym 4 ): Kim ([K]) 

(4, A 2 ): Kim ([K]) 

In this paper we will make use of the last instance of functoriality, namely 
the exterior square transfer of automorphic forms from GL(4) to GL(6). 

1.3 Rankin- Selb erg L-functions 

The results here are due to the independent and partly complementary, deep 
works of Jacquet, Piatetski-Shapiro and Shalika, and of Shahidi. Let ir, ir' be 
isobaric automorphic representations in A(n, F), A(n', F) respectively. Then 
there exists an associated Euler product L(s,7r x it') ([JPSS], [JS1], [Shi, 2], 
[MW], [CoPS2]), which converges in {Sft(s) > 1}, and admits a meromor- 
phic continuation to the whole s— plane and satisfies the functional equation, 
which is given in the unitary case by 

(1.3.1) L(s, nxn') = e(s, tt x ir')L(l - s, tt v x tt /V ), 
with 

e(s,n x ir') = W(ir x 7r')iV(7r x n')^~ s , 

where the conductor N(ir x ir') is a positive integer not divisible by any 
rational prime not intersecting the ramification loci of F/Q, ir and ir', while 
W(ir x 7r') is the root number in C*. As in the Galois case, W(ir x ir')W{ir w x 
7r /V ) = 1, so that W(ir x n') = ±1 when 7r, tv' are self-dual. 

It is easy to deduce the functional equation when ir, ir' are not unitary. If 
they are cuspidal of weights w, w' respectively, the functional equation relates 
s tow + Mj' + l- s. Moreover, since 7r v , 7r' v have respective weights —w, —w', 
7r x ir v ee and ir' x tt' v still have weight 0. 

When v is archimedean or a finite place unramified for ir, ir', 

(1.3.2) L v (s, 7T x ir') = L(s, a{n v ) ® <r«)). 

In the archimedean situation, ir v — > cr(7r„) is the arrow to the representa- 
tions of the Weil group Wp v given by [Lai]. When v is an unramified finite 
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place, o~(n v ) is defined in the obvious way as the sum of one dimensional 
representations defined by the Langlands class A(tt v ). 

When n — 1, L(s,tt x 7r') = L(s,tttt'), and when n = 2 and F — Q, 
this function is the usual Rankin- Selberg L— function, extended to arbitrary 
global fields by Jacquet. 

Theorem 1.3.3 ([JS1], [JPSS]) Let ir e %(n,F), ir' E %(n',F), and S 
a finite set of places. Then L s (s,n x n') is entire unless n is of the form 
tt' v <g> in which case it is holomorphic outside s = w, 1 — w, where it has 
simple poles. 

The Principle of Functoriality implies in this situation that given ir, ir' as 
above, there exists an isobaric automorphic representation 7rKl7r' of GL(nn', Ap) 
such that 

(1.3.4) L( S , 7T Kl 7r') =, L( S , 7T x tt'). 

The (conjectural) functorial products is the automorphic analogue of the 
usual tensor product of Galois representations. For the importance of this 
product, see [Ral], for example. 

One can always construct 7rKl7r' as an admissible representation of GL (nn', A/), 
but the subtlety lies in showing that this product is automorphic. 

The automorphy of Kl is known in the following cases, which will be useful 
to us: 
(1.3.5) 

(n,n') = (2,2): ([Ra2]) 

(n, n') = (2, 3): Kim-Shahidi ([KShl]) 

The reader is referred to section 11 of [Ra4], which contains some refine- 
ments, explanations, refinements and (minor) errata for [Ra2]. It may be 
worthwhile remarking that Kim and Shahidi use the functorial product on 
GL(2)xGL(3) which they construct to prove the symmetric cube lifting for 
GL(2) mentioned in the previous section (see (1.2.11). A cuspidality criterion 
for the image under this transfer is proved in [Ra-W] , with an application to 
the cuspidal cohomology of congruence subgroups of SL(6, Z). 
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1.4 Modularity and the problem at hand 



The general Langlands philosophy asserts that if pe is an n-dimensional £- 
adic representation of Qq arising as a factor of the cohomology of a smooth, 
projective variety over Q, then there is an isobaric automorphic representa- 
tion 7r of GL(n, A) such that for a suitable finite set S of places (including 
oo), we have an identity of the form 



When this happens, we will say that pn is modular, and we will write 



One says that pe is strongly modular if the identity (1.4.1) holds for the full 
L-function, i.e., with S empty. 

Recall from (the end of) section 1.1 that a striking conjecture of Fontaine 
and Mazur ([FoM]) asserts that a Galois representation p t comes from arith- 
metical geometry, as required in the modularity conjecture above, if it is 
potentially semistable at i and has good reduction at almost all primes. 

Special cases of the modularity conjecture were known earlier, the most 
famous one being the modularity conjecture for the £-adic representations pe 
defined by the Galois action on the £-power division points of elliptic curves E 
over Q, proved recently in the spectacular works of Wiles, Taylor, Diamond, 
Conrad and Breuil. 

We will not consider any such (extremely) difficult question in this article. 
Instead we will be interested in the following: 

Question 1.4.3 When a modular pi is irreducible, is the corresponding n 
cuspidal? And conversely? 

This seemingly reasonable question turns out to be hard to check in di- 
mensions n > 2. 

One thing that is clear is that the ir associated to any pi needs to be 
algebraic in the sense of Clozel ([G£L]). To define the notion of algebraicity, 
first recall that by Langlands, the archimedean component is associated 
to an n-dimensional representation cr^oo), sometimes written 000(71"), of the 
real Weil group W^, with corresponding equality of the archimedean L-f actors 
L<x>(s, pi) and L(s, n^). We will normalize things so that the correspondence 



(1.4.1) 




(1.4.2) 



Pi <-> 7T. 
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is algebraic. One can explicitly describe as C* U jC*, with jzj 1 = z and 
j 2 = — 1. One gets a canonical exact sequence 

(1.4.4) 1 -> C* -> W M -> S K -> 1 

which represents the unique non-trivial extension of £r by C*. One has a 
decomposition 

(1-4.5) <7(7roo)|c. ^ ®"=i&, 

where each £j is a (quasi-) character of C*. One says that n is algebraic when 
every one of the characters is algebraic, i.e., there are integers Pj,qj such 
that 

(1.4.6) Xj(z) = z Pj ^. 

This analogous to having a Hodge structure, which is what one would expect 
if 7r were to be related to a geometric object. 

One says that n regular if for all i ^ j, Xi Xj- m other words, each 
character Xj appears in the restriction of (J 00 { , k) to C* with multiplicity one. 
We say (following [BHR]) that n is semi-regular if the multiplicity of each Xj 
is at most 2. 

When n — 2, any 7r defined by a classical holomorphic newform f of 
weight fc > 1 is algebraic and semi-regular. It is regular iff k > 2. One 
also expects any Maass waveform <p of weight and eigenvalue 1/4 for the 
hyperbolic Laplacian to be algebraic; there are interesting examples of this 
sort coming from the work of Langlands (resp. Tunnell) on tetrahedral (resp. 
octahedral) Galois representations p which are even; the odd ones correspond 
to holomorphic newforms of weight 1. We will not consider the even situation 
in this article. 

Given a holomorphic newform f(z) = J^^Li a nQ n , 1 = e 2mz , of weight 2, 
resp. k > 3, resp. k — 1, level iV and character u, one knows by Eichler 
and Shimura, resp. Deligne ([De]), resp Deligne-Serre ([DeS]), that there is 
a continuous, irreducible representation 

(1.4.7) pi :Qq -> GL(2,Q,) 
such that for all primes p \ Nl, 

tr (Fr p \p £ ) = a p 
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and 

det(p £ ) = uxt\ 

where xi is the £-adic cyclotomic character of Qq, given by the Galois action 
on the £-power roots of unity in Q, and Fr p is the geometric Frobenius at p, 
which is the inverse of the arithmetic Frobenius. 

1.5 Parity 

We will first first introduce this crucial concept over the base field Q, as that 
is what is needed in the remainder of the article. 

We will need to restrict our attention to those isobaric forms it on GL(n)/Q 
which are odd in a suitable sense. It is instructive to first consider the case of 
a classical holomorphic newform / of weight k > 1 and character uo relative 
to the congruence subgroup T (N). Since T (N) contains —I, it follows that 
uj(—1) = (— l) k . One could be tempted to call an defined by such an / to be 
even (or odd) according as uo is even (or odd), but it would be a wrong move. 
One should look not just at u, but at the determinant of the associated pe, 
i.e., the ^-adic character ujx\~ x ■, which is odd for all k ! So all such it defined 
by holomorphic newforms are arithmetically odd. The only even ones for 
GL(2) are (analytic Tate twists of) Maass forms of weight and Laplacian 
eigenvalue 1/4. 

The maximal abelian quotient of Wr is M*, and the restriction of the 
abelianization map to C* identifies with the norm map z — > \z\. So every 
(quasi)-character £ of Wr identifies with one of R*, given by x — > sgn(x) a \x^ 
for some t, with a G {0, 1}. Clearly, £ determines, and is determined by (t, a). 
If 7r is an isobaric automorphic representation, let o-oo[£\ denote, for each such 
£, the ^-isotypic component of a^n). The sign group R* /M* + acts on each 
isotypic component. Let m + (n, £) (resp. m_(ir, £)) denote the multiplicity 
of the eigenvalue +1 (resp. —1), under the action of on Ooo(0- 

Definition 1.5.1 Call an isobaric automorphic representation it of GL(n, A) 
odd if for every one- dimensional representation £ o/Wr occurring in a^ijr), 

|ra+(7r,0 -m_(7r,0l < 1- 

Clearly, when the dimension of o"oo[£] is even, the multiplicity of +1 as 
an eigenvalue of the sign group needs to be equal to the multiplicity of —1 
as an eigenvalue. 
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Under this definition, all forms on GL(1)/Q are odd. So are the 7r on 
GL(2)/Q which are defined by holomorphic newforms of weight k > 2. The 
reason is that is (for k > 2) a discrete series representation, and the 
corresponding <7oo(7r) is an irreducible 2-dimensional representation of W-r 
induced by the (quasi)-character z — > z~( k ~^ of the subgroup C* of index 
2, and our condition is vacuous. On the other hand, if k — 1, (t^tt) is a 
reducible 2-dimensional representation, given by 1 © sgn. The eigenvalues 
are 1 on o"oo(l) and —1 on a 00 (sgn). On the other hand, a Maass form of 
weight and A = 1/4, the eigenvalue 1 (or —1) occurs with multiplicity 2, 
making the n it defines an even representation. So our definition is a good 
one and gives what we know for n = 2. 

For any n, note that if n is algebraic and regular, it is automatically 
odd. If 7r is algebraic and semi-regular, each isotypic space is one or two- 
dimensional, and in the latter case, we want both eigenvalues to occur for n 
to be odd. 

Finally, if F is any number field with a real place u, we can define, in 
exactly the same way, when an algebraic, isobaric automorphic representation 
of GL(n, Ap) is arithmetically odd at u. If F is totally real, then we say that 
7r is totally odd if it is so at every archimedean place. 



2 The first step in the proof 



Let pi, n be as in Theorem A. Since pe is irreducible, it is in particular 
semisimple. Suppose n is not cuspidal. We will obtain a contradiction. 

Proposition 2.1 Let pe,n be associated, with ir algebraic, semi-regular and 
odd. Suppose we have, for some r > 1, an isobaric sum decomposition 

(2.2) TT-ffl^lfe, 

where each rjj a cuspidal automorphic representation of GL(nj,A), with rij < 
2 (Vj). Then pe cannot be irreducible. 

Corollary 2.3 Theorem A holds when it admits an isobaric sum decompo- 
sition such as (2.2) with each rij < 2. In particular, it holds for n < 3. 
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Proof of Proposition. The hypothesis that n is algebraic and semi- 
regular implies easily that each rjj is also algebraic and semi-regular. Let J m 
denote the set of j where rij = m. 

First look at any j in J\. Then the corresponding rjj is an idele class 
character. Its algebraicity implies that, in classical terms, it corresponds to 
an algebraic Hecke character Vj. By Serre ([Se]), we may attach an abelian 
£-adic representation Vj^ of Qq of dimension 1. It follows that for some finite 
set S of places containing £,, 

(2.4) L s (s,Vj t f) = L s (s,r]j) whenever rij — 1. 

Next consider any j in J 2 . If cr(r]j t00 ) is irreducible, then a twist of rjj must 
correspond to a classical holomorphic newform / of weight k > 2. Moreover, 
the algebraicity of rjj forces this twist to be algebraic. Hence by Deligne, 
there is a continuous representation 

(2.5) t u :Q q - GL(2,Q,), 

ramified only at a finite of primes such that at every p ^ £ where the repre- 
sentation is unramified, 

(2.6) tr(Fr p | T jJt ) = a p (rjj), 

and the determinant of corresponds to the central character ujj of rjj. 
Moreover, is irreducible, which is not crucial to us here. 

We also need to consider the situation, for any fixed j G J2, when cr(r)j j00 ) 
is reducible, say of the form xi ®X2- Since rjj is cuspidal, by the archimedean 
purity result of Clozel ([C£l]), XiX^ 1 must be 1 or sgn. The former cannot 
happen due to the oddness of n. It follows that rjj is defined by a classical 
holomorphic newform / of weight 1, and by a result of Deligne and Serre 
([DeS]), there is a 2-dimensional £-adic representation of Qq with finite 
image, which is irreducible, such that (2.6) holds. 

Since the set of Frobenius classes Fr p , as p runs over primes outside S, 
is dense in the Galois group by Tchebotarev, we must have, by putting all 
these cases together, 

(2.7) Pe ~ (® jeJl v u ) © (® jeJ2 Tjtt ) , 

which contradicts the irreducibility of p£, since by hypothesis, r = |Ji| + 
I J 2 | > 2. 

□ 
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3 The second step in the proof 



Let pe, it be as in Theorem A. Suppose it is not cuspidal. In view of Propo- 
sition 2.1, we need only consider the situation where n is an isobaric sum 
SjTjj, with an rjj being a cusp form on GL(m)/Q for some m > 3. 

Proposition 3.1 Let pp,-n be associated, with n an algebraic cusp form on 
GL(n)/Q which is semi-regular and odd. Suppose we have an isobaric sum 
decomposition 

(3.2) 7T ~ 77 ffl 77', 

where rj is a cusp form on GL(3)/Q and r( an isobaric automorphic repre- 
sentation of GL(r, A) for some r > 1 . Moreover, assume that there is an 
r -dimensional £- adic representation r[ of Qq associated to rj'. Then we have 
the isomorphism of Qq-modules: 

(3.3) pt © (p t ® r[) ~ A 2 (p e ) © rf © sym 2 (r;). 

Corollary 3.4 Let pt, n be associated, with it algebraic, semi-regular and 
odd. Suppose n admits an isobaric sum decomposition such as (3.2) with 
r < 2. Then p e is reducible. 

Proposition 3.1 Corollary 3.4: When r < 2, rj' is either an isobaric 

sum of algebraic Hecke characters or cuspidal, in which case, thanks to the 
oddness, it is defined by a classical cusp form on GL(r)/Q of weight > 1. 
In either case we have, as seen in the previous section, the existence of the 
associated £-adic representation r £ ', which is irreducible exactly when r]£ is 
cuspidal. Then by the Proposition, the decomposition (3.3) holds. If r = 1 or 
r = 2 with t]' Eisensteinian, (3.3) implies that a 1-dimensional representation 
(occurring in t' £ ) is a summand of a twist of either pi or p y t . Hence the 
Corollary. 

□ 

Combining Corollary 2.3 and Corollary 3.4, we see that the irreducibil- 
ity of pt forces the corresponding n to be cuspidal when n < 4 under the 
hypotheses of Theorem A. So we obtain the following: 

Corollary 3.5 Theorem A holds for n < 4. 
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Proof of Proposition 3.1. By hypothesis, we have a decomposition as in 
(3.2), and an £-adic representation r[ associated to r]'. 

As a short digression let us note that if rj were essentially self-dual and 
regular, we could exploit its algebraicity, and by appealing to [Pic] associate 
a 3- dimensional £-adic representation to rj. The Proposition 3.1 will follow 
in that case, as in the proof of Proposition 2.1. However, we cannot (and do 
not wish to) assume either that r] is essentially self-dual or that it is regular. 
We have to appeal to another idea, and here it is. 

Let S be a finite set of primes including the archimedean and ramified 
ones. At any p outside S, let n p be represented by an unordered (3 + r) -tuple 
{«!, . . . , a 3+r } of complex numbers, and we may assume that i] p (resp. r)' p ) is 
represented by {«!, a 2 , a 3 } (resp. {0:4, . . . , a 3+r }. It is then straightforward 
to check that 

(3.6) L(s, 7c p , A 2 ) = L(s, V ;)L(s, Vp x V ' p )L(s, rf; A 2 ). 

One can also deduce this as follows. Let cr(/3) denote, for any irreducible 
admissible representation (3 of GL(m, Q p ), the m-dimensional representation 
of the extended Weil group Wq = Wq p x SL(2,C) defined by the local 
Langlands correspondence (cf. [HaT], [He]). For any representation er of 
Wq which splits as a direct sum r © r', we have 

(3.7) A 2 (a) ~ A 2 (r) © r ® r' © A 2 (r'), 
with A 2 (r') = if r' is 1-dimensional and 

(3.8) A 2 (r) ~ r v when dim(r) = 3. 

In fact, this shows that the identity (3.6) works at the ramified primes as 
well, but we do not need it. 

Now, since 7r v ~ if ffl r]' v , we get by putting (3.2) and (3.6) together, 

(3.9) L(s : 7r;)L(s : 7r p xrj' p )L(s,rj' p -A 2 ) = L(s, n p , A 2 )L(s, V ' p v )L(s, rj' p x rj' p ). 

Appealing to Tchebotarev, and using the correspondences it <-> and rj' <-> 
Tg, we obtain the following isomorphism of ^Q-representations: 

(3.10) p v e © (p e © r[) © A 2 (r;) ~ A 2 (p^) © © {r[ © r[) . 



22 



Using the decomposition 



r;®r; ~sym 2 (r;)©A 2 (7-;), 
we then obtain (3.3) from (3.10). 

□ 

4 Galois representations attached to regular, 
selfdual cusp forms on GL(4) 

A cusp form II on GL(m)/F, F a number field, is said to be essentially 
selfdual iff n v ~ II ® A for an idele class character A; it is selfdual if A = 1. 
We will call such a A a polarization. Let us call II almost selfdual if there is a 
polarization A of the form /x 2 | - |* for some t G C and a finite order character 
fj,; in this case, one sees that (IT(g>/i) v ~ II<g>/i| • |*, or equivalently, n®/x| • |*/ 2 
is selfdual. Clearly, if II is essentially selfdual, then it becomes, under base 
change ([AC]), almost selfdual over a finite cyclic extension K of F. 

Note that when II is essentially selfdual relative to A, it is immediate that 
Aqo occurs in the isobaric sum decomposition of IIoo IE IIoo, or equivalently, 
^(Aoo) is a constituent of aijlco)® 2 . This implies that if II is algebraic, then 
so is A, and thus corresponds to an £-adic character A^ of Qq. 

Whether or not II is algebraic, we have, for any S, 

(4.1) L s (s, IT x II <g> A" 1 ) = L s (s, II, sym 2 <g> A _1 )L s (s, n ; A 2 <g> A" 1 ), 

The L-function on the left has a pole at s = 1, since II V ~ II ® A by 
hypothesis. Also, neither of the L-functions on the right is zero at s = 1 
([JS2]). Consequently, exactly one of the L-functions on the right of (4.1) 
admits a pole at s = 1. One says that II is of orthogonal type ([Ra3]), resp. 
symplectic type, if L 5 (s,II,sym 2 <g> A -1 ), resp. L 5 (s,II,A 2 ® A -1 ) admits a 
pole at s = 1. 

The following result is a consequence of a synthesis of the results of a 
number of mathematicians, and it will be crucial to us in the next section, 
while proving Theorem A for n — 5. 
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Theorem B Let U be a regular, algebraic cusp form on GL(4)/Q, which is 
almost selfdual. Then there exists a continuous representation 

R e :G Q ^ GL(4,Q,), 

such that 

L s (s,U;A 2 ) = L s (s,A 2 (R e )), 

for a finite set S of primes containing the ramified ones. Moreover, if U is 
of orthogonal type, we can show that R e and II are associated, i.e., have the 
same degree 4 L-functions (outside S). 

When II admits a discrete series component U p at some (finite) prime p, 
a stronger form of this result, and in fact its generalization to GL(n)/Q, is 
due to Clozel ([C£2]). But in the application considered in the next section, 
we will not be able to satisfy such a ramification assumption at a finite place. 

In the orthogonal case, II descends by the work of Ginzburg-Rallis-Soudry 
(cf. [So]) to define a regular cusp form (3 on the split SGO(4)/Q, which is 
given by a pair (tti, 7r 2 ) of regular cusp forms on GL(2)/Q. By Deligne, there 
are 2-dimensional (irreducible) £-adic representations T± t e, t 2 /, with <-> ttj, 
j = 1,2. This leads to the desired 4-dimensional ((^-representation R% := 
Ti,i ® t 2 / of Qq associated to IT, such that 

(4.2) L s (s,R e ) = L s (s,U). 

It may be useful to notice that since the polarization is a square (under the 
almost selfduality assumption), the associated Galois representation takes 
values in SGO(4, Q e ), which is the connected component of GO (4, Q e ), with 
quotient {±1}. In the general case, not needed for this article, Re will need 
to be either of the type above or of Asai type (see [Ra4]), associated to a 
2-dimensional ((^-representation Gal(Q/ K) for a quadratic extension K/Q. 

In the (more subtle) symplectic case, this Theorem is proved in my joint 
work [Ra-Sh] with F. Shahidi. We will start with a historical comment and 
then sketch the proof (for the benefit of the reader). Some years ago, Jacquet, 
Piatetski-Shapiro and Shalika announced a theorem, asserting that one could 
descend any II (of symplectic type on GL(4)/Q) to a generic cusp form f3 on 
GSp(4)/Q with the same (incomplete) degree 4 L-functions. Unfortunately, 
this work was never published, except for a part of it in [JSh2]. In [Ra-Sh], 
Shahidi and I provide an alternate, somewhat more circuitous route, yielding 
something slightly weaker, but sufficient for many purposes. Here is the idea. 
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We begin by considering the twist n := II<g>/i| • |*/ 2 instead of n, to make the 
polarization is trivial, i.e., so that n has parameter in Sp(4, C). Using the 
backwards lifting results of [GRS] (see also [So]), we get a generic cusp form 
n' on the split SO(5)/Q, such that n — * IT is functorial at the archimedean 
and unramified places. Using the isomorphism of PSp(4)/Q with SO(5)/Q, 
we may lift II' to a generic cusp form IT on Sp(4)/Q. By a suitable extension 
followed by induction, we can associate a generic cusp form Hi on GSp(4)/Q, 
such that the following hold: 
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(4.3) 

(i) The archimedean parameter of n 2 := II ! <g> ■ |~*/ 2 is algebraic and 
regular; and 

(ii) L(s, n 2)fl ; A 2 ) = L(s, U p ; A 2 ) at any prime p where II is unramified. 

We in fact deduce a stronger statement in [Ra-Sh], involving also the 
ramified primes, but it is not necessary for the application considered in this 
paper. To continue, part (i) of (4.3) implies that U 2 contributes to the (inter- 
section) cohomology of (the Baily-Borel-Satake compactification over Q of) 
the 3-dimensional Shimura variety Shx/Q associated to GSp(4)/Q, relative 
to a compact open subgroup K of GSp(4, Aj); Shx parametrizes principally 
polarized abelian surfaces with level .fT-structure. Now by appealing to the 
deep (independent) works of G. Laumon ([Laul,2]) and R. Weissauer ([Wei]), 
one gets a continuous 4-dimensional £-adic representation Re of Qq such that 

(4.4) L s (s,Tl 2 ) = L s (s,R e ). 

The assertion of Theorem B now follows by combining (4.3) (ii) and (4.4). 

□ 



5 Two useful Lemmas on cusp forms on GL(4) 

Let F be a number field and r\ a cuspidal automorphic representation of 
GL(4, A F ), where A F := A ®q F is the Adele ring of F. Denote by lu v the 
central character of 77. 

First let us recall (see (1.2.11)) that by a difficult theorem of H. Kim 
([K]), there is an isobaric automorphic form A 2 (77) on GL(6)/Q such that 

(5.1) L(s,A 2 ( V )) = £(*,?/■; A 2 ). 

Lemma 5.2 A 2 (r?) is essentially self dual. In fact 
(5.3) A 2 (77) v ~ K 2 (ri)®uj- 1 

Proof. Thanks to the strong multiplicity one theorem for isobaric automor- 
phic representations ([JS1]), it suffices to check this at the primes p where 77 
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is unramified. Fix any such p, and represent the semisimple conjugacy class 
A p (rj) by [a, b, c, d}. Then it is easy to check that 

(5.4) A p (A 2 (r])) = A 2 (A p (r])) = [ab,ac,ad,bc,bd,cd\. 

Since for any automorphic representation II, the unordered tuple representing 
A p (n v ) consists of the inverses of the elements of tuple representing A p (ir), 
and since A p {uj v ) = [abed], we have 
(5.5) 

A p (A 2 (r]) y <g> u v ) = [(ab)-\ (ac)- 1 , (ad)" 1 , (bc)~\ (bd)' 1 , (cd)' 1 } <g> [abed], 
which is none other than A p (A 2 (r])). The isomorphism (5.3) follows. 

□ 

Lemma 5.6 Let rj be a cusp form on GL(4)/F with trivial central character. 
Suppose i] v ^ T). Then there are infinitely many primes P in Of where rjp is 
unramified such that 1 is not an eigenvalue of the conjugacy class Ap(A 2 (rj)) 
ofA 2 ( VP ). 

Proof of Lemma 5.6. Since i] v g£. r], there exist, by the strong multiplicity 
one theorem, infinitely many unramified primes P where rfp rjp. Pick any 
such P, write 

Apijf) = [a,b,c,d\, with abed — 1. 

The fact that rfp ^ rjp implies that the set {a, b, c, d} is not stable under 
inversion. Hence one of its elements, which we may assume to be a after 
renaming, satisfies the following: 

Equivalent ly, 

1 ^ {a 2 , ab, ac, ad}. 

On the other hand, we have (5.4), using which we conclude that the only 
way 1 can be in this set (attached to A 2 (i]p)) is to have either be or bd or cd 
to be 1. But if 6c = 1 (resp. bd = 1), since abed = 1, we must have ad = 1 
(resp. ac = 1), which is impossible. Similarly, if cd = 1, we are forced to 
have ab — 1, which is also impossible. 

□ 
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6 Finale 



Let pe, ii be as in Theorem A. In view of Corollary 3.5, we may assume from 
henceforth that n — 5, and that it is algebraic and regular. Suppose tt is not 
cuspidal. In view of Corollary 2.3 and Corollary 3.4, we must then have the 
decomposition 

(6.1) 7r ~ rj EE v, 

where 77 is an algebraic, regular cusp form on GL(4)/Q and v an algebraic 
Hecke character, with associated £-adic character vi. 

Note that Theorem A needs to be proved under either of two hypotheses. 
To simplify matters a bit, we will make use of the following: 

Lemma 6.2 There is a character z/ with — 1 such that for p = v§v~ x , 
if n is almost self dual, then so is n ® pT 1 . 

Proof of Lemma When ir is almost selfdual, there exists, by definition, an 
idele class character p such that p is selfdual. But this implies, thanks to 
(6.1) and the cuspidality of rj, that i] <g> \i is selfdual and \iv is 1 or quadratic. 
We are done by taking v = jj,u. 

□ 

Consequently, we may, and we will, replace n by n (g) ji, pi by p e (g) p e , 
r] by i] <S> p and v by up, without jeopardizing the nature of either of the 
hypotheses of Theorem A. In fact, the first hypothesis simplifies to assuming 
that n is selfdual. Moreover, 

(6.3) v 2 = 1. 

Proof of Theorem A when n is almost selfdual: 

We have to rule out the decomposition (6.1), which gives (for any finite 
set S of places containing the ramified and unramified ones): 

(6.4) L s (s,tt) = L s (s, V )L s (s,u) 

As noted above, we may in fact assume that tt is selfdual and that v 2 — 1. 
Then the cusp form rj will also be selfdual and algebraic. We may then apply 
Theorem B and conclude the existence of a 4-dimensional, semisimple £-adic 
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representation rg associated to rj. Then, expanding S to include £, we see 
that (6.2) implies, in conjunction with the associations rr <-> pg, r] <-> 7^, 

(6.5) ^ 5 (s,P^) = L s ( S ,r,)L 5 (s,z/,). 
By Tchebotarev, this gives the isomorphism 

(6.6) ~ rg © 1^, 
which contradicts the irreducibility of pg. 

□ 

Proof of Theorem A for general regular n: 

Suppose we have the decomposition (6.1). Again, we may assume that 
v 2 = 1. 

Let us = u w denote the central character of ir. Then from (6.1) we obtain 

(6.7) uj = oj^v. 

Proposition 6.8 Assume the decomposition (6.1), and denote by u the 
central character of it with corresponding I- adic character ujg. 

(a) We have the identity 

L s (s,it;A 2 )L s (s,it v ®ujv)( s (s) = L s (s, tt v ; A 2 ®uj)L s (ir®v)L s (s, uu). 

(b) There is an isomorphism of Qq-modules 

^ 2 (pe) © (pl ®ujg)®l~ (A 2 (pg) <g> ujgvg) © [pg © vg) © ujgvg. 

Proof of Proposition 6.8. (a) It is immediate, by checking at each 
unramified prime, that 

(6.9) L s (s, tt; A 2 ) = L s (s, K 2 (rj))L s (r] © v), 
and (since v = v~ v ) 

(6.10) L s (s,7r v ;A 2 ) = L s (s,A 2 (r) v ))L s (r) v 
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Since oj = we get from Lemma 5.2 that A 2 (?7 V ) is isomorphic to A 2 (77) ® 
lo~ x v. Twisting (6.10) by uu, and using the fact that 

(6.11) L s (r] y ®uj)= L s (s, tt v <g> uj)/L s (s, uu), 
we obtain 

(6.12) L s (s, tt v ; A 2 <g> cuz/)L 5 (s, wi/) = L 5 (s, A 2 (^))L 5 (s, tt v <g> w). 
Similarly, using (6.9) and the fact that 

L s {s,7]®v) = L s (s,n ®v)/( s (s), 
we obtain the identity 

(6.13) L s (s, vr; A 2 )( s (s) = L s (s, A 2 ( V ))L s (s, tt <g> u). 

The assertion of part (a) of the Proposition now follows by comparing (6.12) 
and (6.13). 

(b) Follows from part (a) by applying Tchebotarev, since pe <-> n. 

□ 

Proposition 6.14 We have 

(a) lov — 1. 

(b) pi ~ P/ . 

Proof of Proposition 6.14. (a) Since pe is irreducible of dimension 5, it 
cannot admit a one-dimensional summand, and hence part (b) of Proposition 
6.8 implies that either ueve = 1 or 

uj(Vt C A 2 (p e ). 

Since the first case gives the assertion, let us assume that we are in the second 
case. But then, again since pe is irreducible, and since A 2 (pe) is a summand 
of pe® pi, we must have 

pi ^ Pe ® {ujevey 1 - 
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In other words, is essentially selfdual in this case. Then so is n. More 
explicitly, we have (since v 2 = 1) 

if EH V ~ 7T V ~ 7T(g)C<J _1 Z/ ~ T] ® UJ^ 1 V Ri UJ^ 1 . 

As is cuspidal, this forces the identity 

v = u^ 1 . 

Done. 

(b) Thanks to part (a) (of this Proposition), we may rewrite part (b) of 
Proposition 6.8 as giving the isomorphism of ^Q-modules 

(6.15) A 2 (p e ) © (pi © uj e ) ^ (A 2 (p^ )) © {pi © ^). 

We now need the following: 

Lemma 6.16 Suppose pi is not selfdual. Then 

(6.17) pt®v t <t A 2 (pe). 

Proof of Lemma 6.16. The hypothesis on pg implies that n is not selfdual, 
and since n = r\ ffl z/, r\ is not selfdual either. 

Suppose (6.17) is false.. Then, since pg <-> 7r, we must have 

(6.18) A p (tt©z/) C A p (ir;A 2 ), Vp ^ S, 
for a finite set 5 1 of primes. But we also have 

(6.19) A p (n®v) = A p (r]®u)@l 
and 

(6.20) A p (n; A 2 ) = A p (A 2 (r])) © A P ( V © z/). 
Substituting (6.19) and (6.20) in (6.18), we obtain 

(6.21) 1 C A p (A 2 (r])) \/p $ S. 

On the other hand, since i] is a non-self dual cusp form on GL(4)/Q of 
trivial central character, we may apply Lemma 5.6 with F — Q, and conclude 
that there is an infinite set of primes T such that 

(6.22) 1 <t A p (A 2 ( V ))\/peT, 
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which contradicts (6.21), proving the Lemma. 

□ 

In view of the identity (6.15) and Lemma 6.16, we have now proved all 
of Proposition 6.14. 

□ 

We are also done with the proof of Theorem A because ir is selfdual when 
the decomposition (6.1) holds, thanks to the irreducibility of pi, and the 
selfdual case has already been established (using the algebraic regularity of 
tt). 

□ 
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